Efficient variable selection method using conditional mutual information
نویسندگان
چکیده
منابع مشابه
Feature Selection in Regression Tasks Using Conditional Mutual Information
This paper presents a supervised feature selection method applied to regression problems. The selection method uses a Dissimilarity matrix originally developed for classification problems, whose applicability is extended here to regression and built using the conditional mutual information between features with respect to a continuous relevant variable that represents the regression function. A...
متن کاملBinary Feature Selection with Conditional Mutual Information
In a context of classi cation, we propose to use conditional mutual information to select a family of binary features which are individually discriminating and weakly dependent. We show that on a task of image classi cation, despite its simplicity, a naive Bayesian classi er based on features selected with this Conditional Mutual Information Maximization (CMIM) criterion performs as well as a c...
متن کاملConditional Dynamic Mutual Information-Based Feature Selection
With emergence of new techniques, data in many fields are getting larger and larger, especially in dimensionality aspect. The high dimensionality of data may pose great challenges to traditional learning algorithms. In fact, many of features in large volume of data are redundant and noisy. Their presence not only degrades the performance of learning algorithms, but also confuses end-users in th...
متن کاملA Feature Selection Method Using a Fuzzy Mutual Information Measure
Attempting to obtain a classifier or a model from datasets could be a cumbersome task, specifically, when using datasets of high dimensionality. The larger the amount of features the higher the complexity of the problem, and the larger the time that is expended in generating the outcome -the classifier or the model-. Feature selection has been proved as a good technique for choosing features th...
متن کاملEfficient High-Order Interaction-Aware Feature Selection Based on Conditional Mutual Information
This study introduces a novel feature selection approach CMICOT, which is a further evolution of filter methods with sequential forward selection (SFS) whose scoring functions are based on conditional mutual information (MI). We state and study a novel saddle point (max-min) optimization problem to build a scoring function that is able to identify joint interactions between several features. Th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the Korean Data and Information Science Society
سال: 2014
ISSN: 1598-9402
DOI: 10.7465/jkdi.2014.25.5.1079